Evaluating the OntoNL Framework: a Natural Language Interface Generator for Knowledge Repositories
نویسندگان
چکیده
One of the essential activities when providing a software system in general, is to evaluate the system based on qualitative and quantitative measures. We present in this paper the design and implementation of an evaluation framework for the OntoNL Framework, a natural language interface generator for knowledge repositories. We provide the definition and description of the measures, the methodology of evaluation and the results using an application of the OntoNL Framework. The evaluation framework has been based on the standard, ISO 9126, which is concerned primarily with the definition of quality characteristics to be used in the evaluation of software products.
منابع مشابه
The OntoNL Framework for Natural Language Interface Generation and a Domain-Specific Application
We present in this paper the design and implementation of the OntoNL Framework, a natural language interface generator for knowledge repositories, as well as a natural language system for interactions with multimedia repositories which was built using the OntoNL Framework. The system allows the users to specify natural language requests about the multimedia content with rich semantics that resu...
متن کاملOntology-Driven Semantic Ranking for Natural Language Disambiguation in the OntoNL Framework
The measurement of the semantic relatedness has many applications in natural language processing, and many different measures have been proposed. Most of these measures use WordNet as their central resource and not domain ontologies of a particular context. We propose and evaluate a semantic relatedness measure for OWL domain ontologies that concludes to the semantic ranking of ontological, gra...
متن کاملUser Interactions with Multimedia Repositories using Natural Language Interfaces - OntoNL: an Architectural Framework and its Implementation
We present a generalized architectural framework for constructing and using natural language interfaces for interactions with multimedia repositories. The system allows the users to specify natural language queries about the multimedia content with rich semantics. It uses an extensive set of methodologies and tools for linguistic processing, and utilizes the MPEG-7 and the domain ontologies to ...
متن کاملOntoNL: An Ontology-based Natural Language Interaction Generator for Multimedia Repositories
We propose a generalized implementation framework that can be used to easily provide natural language interactions for managing multimedia content and user profiles which are described in the information repository with metadata structured according to international standards like MPEG-7 and TV-Anytime (upper ontologies). The description of the content in the repository may also utilize metadat...
متن کاملSemantic Annotation of Mobile Data for Language Access
Mobile devices both host and collect significant amount of data that could be interesting to users. To make this data easily accessible, it has to be stored in semantic repositories using a well-defined ontology. Relationships between data from various sources should be explicit. Natural language interface to such data is an attractive option for information access. However, there are semantic ...
متن کامل